The generality/specificity of expertise in scientific reasoning

Previous research on scientific reasoning has shown that it involves a diverse set of skills. Yet, little is known about generality or domain specificity of those skills, an important issue in theories of expertise and in attempts to automate scientific reasoning skills. We present a study designed to test what kinds of skills psychologists actually use in designing and interpreting experiments and contrast expertise within a particular research area with general expertise at designing and interpreting experiments. The results suggest that psychologists use many domain-general skills in their experimentation and that bright and motivated Carnegie Mellon undergraduates are missing many of these skills. We believe that these results have important implications for psychological and artificial intelligence models of expertise, as well as educational implications in the domain of science instruction.